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Abstract 

The purpose of the present study was twofold: first to adapt the Relationship and Motivation (REMO) scale 
addressing role of peers and teachers in students’ motivations into Turkish culture, and second to determine 
whether there were any differences between girls and boys regarding the scores obtained from this scale. To 
achieve these aims, the present research was designed to be comprised of three consecutive studies. In Study 1, 
linguistic equivalence was established, and results of an Explanatory Factor Analysis (EFA) performed on data 
obtained from 202 students showed that structure of the original scale was supported. In Study 2, a Confirmatory 
Factor Analysis (CFA) was conducted using data obtained from 496 Turkish students, and the results confirmed 
the results of EFA. Additionally, the validity evidence was obtained by conducting another EFA with 528 
students. Moreover, reliability coefficients were also found to be varying in an acceptable range. Including the 
same participants of Study 2 in Study 3, t-test results showed that girls had significantly higher mean scores on 
the subscales of peers and teachers as positive motivators, and teachers as negative motivators. On the other hand, 
boys had significantly higher mean scores on the scale of peers as negative motivators. Results of these studies 
suggest that Turkish version of REMO is conceptually equivalent to original REMO, and similarly reliable and 
valid. Therefore, the adapted scale can not only be used in cross-cultural comparison and but also for 
determining the differentiation in the relations of students with their peers and teachers. 

Keywords: individual learning, motivation, scale adaptation, sex differences, peer relations, teacher relations 

1. Introduction 

Most theories of motivation (e.g., cognitive attribution theoiy of motivation and emotion [CATME; Weiner, 
1972], achievement goal theory [AGT; Elliot, 1997], and self-determination theory [SDT; Deci & Ryan, 1985]) 
focus on factors related to achievement-oriented behaviors. According to SDT, individuals are self-motivated and 
willing to succeed. However, this theory assumes that some people may be amotivated due to the social 
environments with which they interact (Deci & Ryan, 2008). Self-determination theory refers to three 
fundamental needs, namely competence, autonomy, and relatedness to others (Deci & Ryan, 2000). If the social 
context satisfies these needs, this will encourage individuals to be active and increase their motivation resulting 
in positive psychological and behavioral outcomes (Ryan & Deci, 2000). On the other hand, if the social 
environment fails to address these needs, motivation may be adversely affected. Within the educational context, 
one of the social environments is school where classmates and teachers may affect students’ motivation and 
engagement (Reeve, 2006). 

Adolescent students tend to think that their peers understand them better than their families and therefore, they 
make an effort to be a natural part of their peer group and to be liked by their peers (Kiran-Esen, 2013). A peer 
may be defined as “an identical person in terms of specific qualities such as skills, success level, age, past and 
socio-economical level” (Reber A. & Reber E., 2001, p. 518). During adolescence, certain social needs such as 
sense of belonging, acceptance, social approval, and bonding are experienced more intensely and affected by 
young individuals’ peer group (Aydin, 2008). Student-student interaction plays a key role in helping students 
become socialized, avoid anti-social behaviors, shape students’ mental health, develop their sexuality, understand 
others better (empathy), avoid self-centeredness, increase their willingness to continue their education and have 
better academic success (Krunke & Raufelder, 2014; Ydmaz, 2001). It has been reported that peer relations are 
particularly important to students’ academic success (Ladd, Herald-Brown, & Kochel, 2009). In addition. 
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students’ relations with their peers play a role in their academic motivation (Juvonen & Wentzel, 1996; Ladd et 
al., 2009; Reindl, Berner, Scheunpflug, Zeinz, & Dresel, 2015; Wentzel, Battle, Russell, & Looney, 2010). On 
the other hand, among learning theories, those of Kolb (1984) and Keen and Mahanty (2006) place emphasis on 
individual learning (Armitage, Marschke, & Plummer, 2008). To increase academic success, teachers who 
implement alternative learning methods have discovered that some of their students are more successful both 
individually and in comparison with their peers (Dunn & Honigsfeld, 2013). 

Since the student-teacher relation affects students’ psychological and cognitive characteristics in various ways, 
motivation theories have emphasized that students’ perception of their relationship with their teacher has an 
impact on their performance (Fan & Wiliams, 2010; Ryan, Stiller, & Lynch, 1994). In particular, attachment 
theory emphasizes the influence of student attachment to school (Bowlby, 1969; Bretherton, 1987), and social 
support models focus on students’ social skills as well as skills of coping with problems (Sarason, Sarason, & 
Pierce, 1990), and Ryan and Deci (2000) have emphasized that student-teacher relations affect students’ social 
and academic participation. Thus, there is a consensus among researchers that the quality and nature of the 
student-teacher relationship plays an important part in students’ learning motivation (Becker & Luthar, 2002; 
Pianta, Flamre, & Stuhlman, 2003; Skinner & Belmont, 1993). 

Researchers have also found sex differences in academic motivation (Csizer & Dornyei, 2005; Karsenti & 
Thibert, 1994; Kissau, 2006; Meyer, Weir, McClure, Walkey, & McKenzie, 2009; Thibert & Karsenti, 1996; 
Thibert & Karsenti, 1998; Watt, 2004). The nature of teacher-student relation affects students’ motivation and 
achievement based on the sex of the students. Several studies (Saft & Pianta, 2001; Silver, Measelle, Armstrong, 
& Essex, 2005) have shown that as opposed to girls, boys’ relationships with their teachers are defined by less 
closeness and more conflict. This is because boys have a tendency to disobey rules as well as being more 
self-regulated than girls (JTughes & Kwok, 2006). Flowever, there is no consensus between these researchers 
concerning how or why this relationship is observed. 

Given the crucial role of students’ relations with their teachers and peers in their motivation and achievement, 
defining these relationships and students’ motivation would provide information necessary for understanding 
students and their education, which are the main focus of education. These relationships have a significant role in 
all cultures, in particular those that are collectivistic (Trumbull & Rothstein-Fisch, 2011). This is because in 
collectivistic societies, connectedness among members of groups is highly valued (Rhee, (Jleman, & Lee, 1996; 
Zhang, Chen, Greenberger, & Knowles, 2017) whereas in individualistic societies, autonomy, independence, and 
individualized relationships are important (Flofstede, 1980). Therefore, the link between these relationships and 
motivation also varies with respect to different cultures. In fact, motivation is “no longer an individual construct, 
but one that is shaped by the cultural, social and educational context in which the learner is operating” (Engin & 
McKeown, 2012, p. 2). More specifically, in educational settings, students from Eastern collectivistic societies 
tend to be more socio-motivationally dependent on their relations in class (Chiu & Chow, 2010) whereas 
students in Western individualistic societies depend less on these relationships in terms of their motivation 
(Flesse, 2004). To effectively identify such relationships with different patterns in different cultures, various 
measurements are used. 

In Turkey, there is no scale that measures the role of both teachers and peers on students’ relations and 
determines how these relations vary according to students’ sex; therefore, there is an essential need to establish a 
valid and reliable measurement tools that will address the relations of students in the Turkish culture. This study 
aimed to fill this gap in the literature by adapting the REMO scale (Raufelder, Drury, Jagenow, Floferichter, & 
Bukowski, 2013) which is a valid and reliable measurement tool into Turkish culture. This scale was designed to 
identify the relationships of German students aged 11 to 17 years with their peers and teachers as well as their 
academic motivation. Given that socio-motivational dependency on teachers and peers varies depending on 
potential differences between cultural contexts, adaptation of a scale that was originally developed for a Western 
culture, namely German, to an eastern culture may also provide contribution to understanding about how these 
relations are established in individualistic and collectivistic societies. 

To obtain valid and reliable measurement tool which can provide realistic results about the role of teachers and 
peers on students’ academic motivation in different culture, this research was divided into three studies; (1) 
Study 1 aimed to adapt REMO to the Turkish culture, establish linguistic equivalence, and determine the clarity 
of the adapted items and whether they have the same factor structure as in the original scale; (2) Study 2 aimed 
to determine validity and reliability of the Turkish version of the scale, and (3) Study 3 aimed to test whether 
measurement invariance across sex was established, and to determine whether there were any differences 
between the two groups of adolescents (boys and girls) in terms of their scores from this scale. 
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2. Study 1 

2.1 Method 

2.1.1 Participants 

For the evaluation of the linguistic equivalence between the original and Turkish versions of the scale, both 
measures were administered to 20 Turkish students enrolled in a university where the language of instruction is 
English at one-week intervals. The reason why the scale was applied to a different student group for the analysis 
of equivalence was because none of the students in the sample group had a sufficient level of English. 

A pilot study was conducted with 202 Turkish students from public schools using purposive sampling. In the 
sampling process, students were recruited by considering the characteristics of the sample that was administered 
the original scale, e.g., regarding age range. Therefore, for the pilot study, the adapted scale was administered to 
the students aged 11 to 16 years. Additionally, the number of the students from different sexes was balanced in 
the pilot study (110 girls, 92 boys). 

In this study, the students’ participation was voluntary. Prior to the data collection, permissions were obtained 
from the appropriate authorities. During the collection process, the students were informed that their responses 
would be kept confidential. In order not to intervene with the natural atmosphere of the class, the class teachers 
administered the measures after being instructed about the standards of the data collection process. Data were 
obtained on different days depending on the availability of teachers and students. 

2.1.2 Measure 

In this study, the original REMO and its Turkish adaptation were used. The original REMO (Raufelder et al., 
2013), which was designed for a German sample, is a four-point Likert scale with 37 items categorized under 
two sub-scales; namely. Peer REMO (P-REMO) and Teacher REMO (T-REMO) containing three and two 
factors, respectively. Moreover, original REMO has both English and German versions. Overall, Turkish version 
of REMO was adapted from English version. The reliability results of the original scale are given in Table 1. 


Table 1. The reliability results of REMO original form 


Scale 

Sub-Scales 

Number of Items 

a 

Split- half 

Test re-test 


Peers as positive motivators 

9 

.80 

.78 

.70 

P-REMO 

Peers as negative motivators 

6 

.73 

.75 

.71 


Individual learning behaviour 

6 

.80 

.79 

.78 

T-REMO 

Teachers as positive motivators 

6 

.78 

.81 

.75 

Teachers as negative motivators 

10 

.82 

.81 

.81 


Source. Raufelder et al. (2013). 


According to the results, the original REMO scale was found to be reliable. Furthermore, various validity tests 
(see Raufelder et al., 2013) indicate that the scale is also valid. 

2.1.3 Procedure 

The adaptation procedure of REMO to Turkish language involves multiple stages described by Flambleton and 
Patsula (1999). Firstly, the scale was translated into Turkish by two different language specialists and researchers. 
The translated version was back-translated into English by four academicians specialized in English language. 
This version was then compared to the original version of the scale by the researchers. It was also reviewed by 
five people specialized in teaching Turkish grammar. After making necessary revisions to the scale according to 
the feedback, the first version of the Turkish adaptation was finalized. 

For the evaluation of the linguistic equivalence for the Turkish scale, both the original and the adapted forms 
were administered to the students at one-week intervals, and expert opinion was sought. For this purpose, a form 
was created and sent to two English language experts and two assessment and evaluation experts. They reviewed 
the scale items to see whether equivalence was achieved in terms of semantics, experiments, conception and 
idioms. 

Within the framework of the data gathered from the pilot study, some words and phrases were revised to achieve 
content integrity within the scale. Some of the revisions were necessary because the students in the age group of 
11-12 years were not familiar with the some of the phrases. 
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2.1.4 Data Analysis 

In order to assess the linguistic equivalence of the adapted form of the scale, Spearman’s Rank Correlation 
Coefficient (SRCC) was used. SRCC was chosen since the normality assumptions was not establied and the 
number of the university students was lower than 30 (n=20). To determine whether consistency between 
linguistic and field experts was established, the inter-rater reliability (Grayson & Rust, 2001) was calculated. 

For the first version of the Turkish form, an Explanatory Factor Analysis (EFA) was carried out for P-REMO and 
T-REMO, separately as in the original scale. Before performing EFA, Kaiser-Mayer-Olkin (KMO) coefficient 
was calculated and Barlett Test was performed. The results of these tests showed that the responses given to 
items in this scale could be factorized. 

Prior to the data analysis, in order to ensure that the assumptions had not been violated, they were checked and it 
was found that all the assumptions (missing data, outliers, normality, multicollinearity, etc.) were established. 
The analyses were tested using SPSS, Mplus and LISREL software. 

2.2 Results 

SRCCs obtained from the original and Turkish versions of the REMO scale varied between .62 and .92, 
indicating that the correlations ranged from moderate to high (Flinkle, Wiersma, & Jurs, 2003). Concerning the 
opinions of the linguistic experts about linguistic equivalence, the consistency between them was found to be 
96%. Within the framework of these results, it can be stated that linguistic equivalence was achieved for the 
adapted version. The results of EFA conducted for the pilot study are given in Table 2. 


Table 2. Factor loadings of P-REMO and T-REMO in pilot study 


Item 

Number 

FI 

F2 

F3 

Item 

Number 

FI 

F2 

Factor 1: Peers as Positive Motivators 



Factor 1: Teachers as Positive Motivators 


35 

.71 

.03 

.01 

20 

.72 

-.01 

21 

.63 

.01 

-.12 

10 

.65 

-.15 

26 

.63 

.19 

-.01 

33 

.64 

-.07 

31 

.57 

.18 

-.37 

36 

.64 

-.02 

16 

.55 

.22 

-.04 

25 

.62 

.09 

11 

.50 

-.29 

.11 

37 

.59 

-.07 

32 

.48 

-.06 

.17 

30 

.59 

-.10 

1 

.43 

-.13 

-.17 

15 

.56 

.07 

8 

-.41 

.40 

-.28 

5 

.53 

.16 

6 

.31 

.01 

-.29 

34 

.42 

.10 

Factor 2: Peers as Negative Motivators 



Factor 2: Teachers as Negative Motivators 

2 

-.03 

.04 

.63 

14 

.03 

.74 

12 

.11 

-.05 

.60 

19 

-.09 

.72 

22 

-.21 

.22 

.55 

24 

-.10 

.68 

17 

-.00 

-.12 

.55 

9 

-.07 

.67 

27 

-.16 

-.02 

.42 

29 

.06 

.66 

7 

.09 

.10 

.32 




Factor 3: Individual Learning 







23 

.15 

.74 

.04 




3 

.06 

.73 

.00 




28 

.08 

.72 

.05 




18 

-.36 

.58 

-.09 




13 

.03 

.47 

.08 




Explained 




Explained 



Variance % Total: 37.13 

15.17 

12.59 

9.37 

Variance % Total: 40.44 

26.09 

14.35 


For P-REMO, the ranges of the factor loadings of the items were .31-.71, .47-.74 and .32-.63 for Factors 1, 2, 
and 3, respectively. Together, all the three factors explained 37.13% of the total variance. In addition, when the 
factor loadings of the items were further examined, it was seen that item 8 had a high loading on more than one 
factor and that the difference between the factor loadings was less than .10. For this reason, this item was 
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considered to be an overlapping item (Tabachnick & Fidell, 2007), and was adjusted to make it more clear to 
ensure that it would be understood in the same way by all individuals in the study group. In addition, the highest 
loading of item 6 was found to be below .32, which made it inadequate to explain its relevant factor (Tabachnick 
& Fidell, 2007); therefore, this item was also revised. 

As seen in Table 2, for T-REMO, the factor loadings of the items under Factor 1 varied between .42 and .72 and 
those under Factor 2 ranged from .66 to .74. Together, Factors 1 and 2 explained 40.44% of the total variance. At 
the same time, it is clear from Table 2 that none of the items overlapped or failed to achieve the acceptable level 
for factor loadings. However, it was observed that in T-REMO, item 5 had high loadings on different factors 
compared to those in the original scale. Therefore, the item was rephrased. 

3. Study 2 

3.1 Method 

3.1.1 Participants and Procedure 

The participants of Study 2 consisted of Turkish students enrolled in the 6th to 9th grades during the 2014-2015 
academic years. Specifically, 496 students (M age =14.30, sd=1.24, range=ll-17; 194 girls, 302 boys) took part in 
the testing of the conformity of the factor structure of REMO, and 528 students (M age =14.10, sd=1.26, 
range=ll-17; 225 girls, 303 boys) were recruited for validity and reliability analyses. In order to ensure the 
representativeness of the high, medium, and low socio-economic levels, schools were selected from three 
provinces in Turkey representing different socio-economic levels according to the indicators of socio-economic 
development. As a result, six public schools (45 randomly selected classes) participated in the survey, of which 
three were high schools and three were middle schools. 

Prior to the data analysis, in order to ensure that the assumptions had not been violated, they were checked and it 
was found that all the assumptions (missing data, outliers, normality, multicollinearity, etc.) were established. 
The confirmatory procedures for the original REMO were based on parcels to build from the factor items 
determined by the factor analysis (Raufelder et ah, 2013). However, in this study, it was preferred to use single 
items for two main reasons; (i) the use of parcels in structural or confirmatory models is considered a 
questionable practice in the literature (Little, Cunningham, Shahar, & Widaman, 2002) and (ii) the relationships 
between latent variables were not the focus of this study. 

To determine the accuracy of the structure of the adapted scale in relation to the original scale, a Confirmatory 
Factor Analysis (CFA) was performed. The following were used as fit indices; chi-square ( x 2 ), 
chi-square/degrees of freedom (x 2 /df), Root-Mean-Square Error of Approximation (RMSEA), Standardized 
Root Mean square Residual (SRMR), Comparative Fit Index (CFI), Non-Normed Fit Index (NNFI), 
Goodness-of-Fit Index (GFI), and Adjusted GFI (AGFI). Furthermore, an EFA was carried out to gather 
evidence for the validity of the Turkish REMO. Before performing EFA, the KMO coefficient was calculated 
and Barlett Test was conducted. The results of these tests showed that the responses given to the items in the 
adapted version of the scale could be factorized. The reliability of the Turkish version of REMO was calculated 
using the coefficients of split-half reliability, Hancock’s H (Hancock & Mueller, 2001), and Cronbach’s alpha. 

3.2 Results 

3.2.1 Verification of REMO in the Turkish Culture 

CFA was carried out to examine the extent to which the data obtained from the adapted P-REMO conformed to 
the original structure with three sub-factors, several goodness-of-fitness indices were obtained as follows: 
x 2 =640. 10 (N=496, df=186, p<.01), x 2 /df=3.44, RMSEA=.07, SRMR=,08, CFI=.83, NNFI=81, GFI=,90 and 
AGFI=.80. According to the findings, the NNFI value indicated a poor fit; x 2 /df, CFI and AGFI values 
demonstrated an acceptable fit; and RMSEA, SRMR and GFI values showed a good fit (Hu & Bentler, 1999; 
Steiger, 2007). An acceptable fit between the data and the model was achieved. All the standardized factor 
loadings were higher than .23 and the t-values of the items were significant (p<.05). The item loadings regarding 
sub-factor peers as positive and negative motivators ranged from .25 to .56 and .26 to .60, respectively, and those 
concerning sub-factor individual learning varied between .23 and .63. In brief, the results of CFA for P-REMO 
showed that the original structure was preserved in the adapted scale. 

CFA was also performed to examine the conformity of the data gathered from T-REMO to the original REMO 
with two sub-factors, and to examine the accuracy of the structure of the adapted version in relation to the 
original form. Regarding goodness-of-fit indices, the following values were obtained: x 2 =275.85 (N=496, 
df=103, p<.01), x 2 /df=2.68, RMSEA=,06, SRMR=.07, CFI=.95, NNFI=,94, GFI= 93, and AGFI=.91. Based on 
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these results, RMSEA, SRMR, NNFI, AGFI, and GFI indicated a good fit, and the x 2 /df and CFI values showed 
a perfect fit (Kline, 2005; Flu & Bentler, 1999; Schumacker & Lomax, 1996). Overall, there was a good fit 
between the data and the model. According to the CFA model of T-REMO, all the standardized factor loadings 
were higher than .45 and the t values of the items were significant (p<.05). The item loadings regarding 
sub-factor teachers as positive and negative motivators ranged from .48 to .63, and from .45 to .63, respectively. 
In brief, the results of CFA for T-REMO supported the claim that the structure of the original REMO was 
maintained in the adapted scale. 

Construct validity of the Turkish version of REMO. EFA was carried out to gather evidence for the construct 
validity of P-REMO and T-REMO. The results showed that the number of principle factors was three for P- 
REMO and two for T-REMO. When determining the number of factors with EFA, the factor loading values of 
the scale items were also checked. Factor loadings of P-REMO and T-REMO in Study 2 were given in Table 3. 


Table 3. Factor loadings of P-REMO and T-REMO in Study 2 



Item 

Number 

Original 

FI 

FI 

F2 

F3 


Item 

Number 

Original 

FI 

FI 

F2 


26 

.52 

.67 

-.02 

.02 


33 

.75 

.75 

-.08 


1 

.67 

.59 

-.04 

.02 


25 

.62 

.69 

-.03 


35 

.64 

.56 

-.10 

.05 


30 

.61 

.68 

-.08 


21 

.64 

.55 

-.21 

.13 


37 

.67 

.66 

-.08 

Factor 1: Peers as 

31 

.65 

.55 

-.31 

.15 

Factor 1: Teachers as 

10 

.62 

.63 

-.14 

Positive Motivators 

16 

.72 

.48 

.03 

.05 

Positive Motivators 

5 

.55 

.63 

.07 


11 

.56 

.48 

.07 

-.21 


20 

.61 

.63 

-.04 


32 

.60 

.44 

.11 

-.14 


36 

.56 

.61 

.12 


6 

.58 

.42 

-.32 

-.02 


15 

.56 

.59 

.21 








34 

.61 

.54 

.10 


Item 

Original 





Item 

Original 




Number 

F2 

FI 

F2 

F3 


Number 

F2 

FI 

F2 


17 

.69 

-.11 

.73 

-.06 


14 

.74 

-.02 

.75 


27 

.67 

-.05 

.69 

-.04 


9 

.71 

-.01 

.69 

Factor 2: Peers as 

12 

.66 

-.08 

.64 

-.08 

Factor 2: Teachers as 

24 

.71 

-.12 

.68 

Negative Motivators 

22 

.70 

.08 

.60 

-.01 

Negative Motivators 

19 

.65 

-.06 

.64 


2 

.66 

-.11 

.47 

-.14 


29 

.68 

.04 

.61 


7 

.69 

.02 

.41 

.18 


4 

.64 

.20 

.54 


Item 

Original 










Number 

F3 

FI 

F2 

F3 







3 

.66 

-.01 

-.09 

.69 







23 

.67 

.04 

-.14 

.66 






Factor 3: Individual 

28 

.84 

.23 

.07 

.64 






Learning 

18 

.71 

-.33 

-.01 

.61 







13 

.66 

.08 

.04 

.52 







8 

.64 

-.38 

-.04 

.48 







Total: 

- 

15.78 

12.25 

9.00 


Total: 

- 

26.57 

16.36 

Explained Variance % 

37.03 





Explained Variance % 

42.93 





The results as given in Table 3 for P-REMO show that the factor loading values of the items under Factors 1, 2, 
and 3 ranged from .42 to .67, .41 to .73, and .48 to .69, respectively. The items were further examined to 
determine whether they loaded on more than one factor and whether they achieved the acceptable level of factor 
loading values. It is found that none of the items overlapped or failed to meet the acceptance level of factor 
loading. The explained factor variances of the Turkish version of P-REMO were found to be 15.78%, 12.25%, 
and 9.00% for Factors 1, 2, and 3, respectively. Together, the three factors explained 37.03% of the total variance 
similar to of the results obtained from the original version of P-REMO (16.18%, 10.96%, and 10.22%, 
respectively see: Raufelder et al., 2013). 
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As shown in Table 3, for T-REMO, the factor loading values of the items under Factor 1 varied between .54 
and .75, and those under Factor 2 ranged from .54 to .75. Furthermore, it was found that none of the items loaded 
on more than one factor and all the items had factor loading values that were at an acceptance level. The 
explained factor variances of the Turkish version of T-REMO were calculated as 26.57% and 16.36% for Factors 
1 and 2, respectively. Together, the two factors explained 42.93% of the total variance similar to the case in the 
original T-REMO (26.33% and 14.67%, respectively, see: Raufelder et al., 2013). 

3.2.2 Reliability of the Turkish REMO 

In this process of the reliability analysis, the coefficients of split-half reliability, Cronbach’s alpha, and 
Flancock’s FI were determined (Table 4). 


Table 4. Reliability coefficient regarding REMO 


Scale 

Sub-Scales 

Item Number 

Split-half 

a 

H 


Peers as Positive Motivators 

9 

.67 

.70 

.69 

P-REMO 

Peers as Negative Motivators 

6 

.64 

.65 

.71 


Individual Learning Behaviour 

6 

.62 

.67 

.68 


Teachers as Positive Motivators 

6 

.70 

.73 

.72 

T-REMO 

Teachers as Negative Motivators 

10 

.81 

.84 

.83 


As shown in Table 4, the coefficient FI values of the subscales were adequately high with the exception of the 
individual learning behavior subscale (H=. 68). However, this value was very close to the acceptable limit of .70. 
The coefficient H values of the remaining subscales ranged from .69 (peers as positive motivators) to .83 
(teachers as negative motivators). Moreover, other reliability coefficients were found to be higher than .62 for 
P-REMO and higher than .70 for T-REMO. According to Nunnally and Bernstein (1994), if the reliability 
coefficient is between .60 and .80, this indicates a fair or marginal-level of reliability. Therefore, the T-REMO 
and P-REMO sub-scales of the adapted REMO were considered to have moderate reliability. 

4. Study 3 

4.1 Method 

The same participants of Study 2 were included in Study 3. The total number of students was 1024 (419 girls, 
605 boys) with their age ranging from 11 to 17 (M age =14.20, sd=1.25). To examine whether measurement 
invariance was achieved for gender groups, a Multi-Group Confirmatory Factor Analysis (MGCFA) was carried 
out. Furthermore, a t-test was performed to analyze the difference between the scores of girls and boys. 

4.2 Results 

The results of MGCFA are given in Table 5. 


Table 5. Fit statistics for REMO across sex 


P-REMO 


Invariance 

x 2 

df 

x 2 /sd 

RMSEA 

CFI 

SRMR 

A RMSEA 

ACFI 

ASRMR 

Girls 

447.15 

186 

2.40 

.06 

.81 

.07 

- 

- 

- 

Boys 

594.73 

186 

3.20 

.06 

.74 

.07 

- 

- 

- 

Configural 

1041.88 

372 

2.80 

.06 

.77 

.07 

- 

- 

- 

Metric 

1076.76 

390 

2.76 

.06 

.77 

.07 

.01 

.02 

.01 

Partial Metric 

1074.83 

389 

2.76 

.06 

.77 

.07 

.01 

.02 

.01 

Scalar 

1270.35 

411 

3.09 

.06 

.71 

.08 

.01 

.08 

.02 

T-REMO 

Girls 

318.39 

103 

3.09 

.07 

.88 

.07 

- 

- 

- 

Boys 

287.79 

103 

2.79 

.05 

.90 

.05 

- 

- 

- 

Configural 

606.18 

206 

2.94 

.06 

.89 

.06 

- 

- 

- 

Metric 

850.94 

220 

3.87 

.11 

.57 

.13 

.04 

.32 

.07 

Partial Metric 

626.02 

219 

2.86 

.06 

.89 

.06 

.01 

.01 

.01 

Scalar 

732.71 

236 

3.10 

.06 

.86 

.08 

.01 

.05 

.02 

Partial Scalar 

709.30 

220 

3.22 

.07 

.86 

.08 

.01 

.02 

.01 
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For P-REMO, fit indices obtained from CFA conducted separately on girls and boys showed an acceptable fit of 
the model to the data for both groups of participants (x 2 =447.15, df=l86, p<.01, CFI=,80, SRMR=.06, 
RMSEA=,06 for girls and x 2 =594.73, df=186, p<.01, CFI=.74, SRMR=,07, RMSEA=,06 for boys). The 
invariance analysis showed that configural invariance (x 2 =1041.88, df=372, p<.01, x 2 /df=2.80, CFI=,77, 
SRMR=.07, RMSEA=,06) was achieved but metric invariance (x 2 =1076.76, df=390, p<.01, x 2 /df=2.76, 
CFI=.77, SRMR=07, RMSEA=,06, ACFI=,02) was not established. Therefore, partial metric invariance tests 
were conducted by freeing the factor loadings of items 6, 12, and 18 in P-REMO that were not found to be 
metrically invariant across groups. As a result, partial metric invariance was not achieved in the model since the 
value of modification index ACFI was above .01 (x 2 =1074.83, df=389, p<.01, x 2 /df=2.76, CFI=.77, SRMR=,07, 
RMSEA=.06, ACFI=.02). 

As shown in Table 5, according to the results of CFA, the fit indices for T-REMO showed an acceptable fit of the 
model to the data obtained from girls (x 2 =318.386, df=103, p<.01, CFI=.88, SRMR=.07, RMSEA=,07), and 
boys (x 2 =287.794, df=l03, p<.01, CFI=.90, SRMR=,05, RMSEA=,05). The invariance analysis revealed that 
configural invariance (x 2 =606.180, df=206, p<.01, x 2 /df =2.94, CFI=.89, SRMR=,06, RMSEA=.06) had been 
established but metric invariance (x 2 =850.94, df=220, p<.01, x 2 /df=3.87, CFI=,57, SRMR=.13, RMSEA=,10, 
ACFI=,32) had not been achieved. Therefore, partial metric invariance tests were conducted by freeing the factor 
loadings of item 5 in T-REMO that were metrically invariant across groups. As a result, partial metric invariance 
was achieved in the model (x 2 =626.02, df=219, p<.01, x 2 /df=2.86, CFI=,89, SRMR=,07, RMSEA=.06, 
ACFI-01). However, scalar invariance (x 2 =732.71, df=236, p<.01, x 2 /df=3.10, CFI=,86, SRMR=,08, 
RMSEA=,06) was not established. Therefore, partial scalar invariance tests were performed by freeing the 
intercept of item 5 in T-REMO. Results indicated that partial scalar invariance (x 2 =709.30, df=220, p<.01, 
x 2 /df=3.22, CFI=,86, SRMR=,08, RMSEA=,06) was not established. When the overall results are evaluated 
while configural invariance models (.77<CFI<89; .05<RMSEA<.06) were maintained in all subscales, metric 
invariance models were not maintained in any of the subscales (.90<CFI<,96; .06<RMSEA<.09). 

When the results regarding measurement invariance of P-REMO and T-REMO were examined, of all the 
modification indices, CFI was found to be lower than the acceptable cut-off limit. Therefore, in this study, the 
values of several modification indices were taken into consideration together. The difference between the scores 
of girls and boys was determined using a t-test (Table 6). 


Table 6. Means, standard deviations, and coefficient t for girls and boys 


Subscales 



Girls 



Boys 




M 


SD 

M 


SD 


P-REMO 

PPM 

26.94 


4.29 

25.56 


4.44 

4.92* 


PNM 

8.98 


2.80 

10.63 


3.19 

-8.67* 


ILB 

15.73 


3.83 

15.39 


3.51 

1.45 

T-REMO 

TPM 

21.54 


2.59 

20.19 


3.08 

7.54* 


TNM 

22.33 


6.72 

21.42 


5.92 

2.22* 


* p <. 05 . 


As shown in Table 6, the results indicated significant differences between boys and girls in terms of their PPM, 
TPM and TNM subscale scores. The girls had significantly higher mean scores in three subscales while boys had 
significantly higher mean scores in the PNM subscale. Regarding individual learning, results did not show any 
significant difference for individual learning. 

5. General Discussion 

The main aim of this study was to adapt the REMO scale to the Turkish culture. To achieve this aim, three 
separate studies were conducted. Specifically, In Study 1, linguistic equivalence was established and the factor 
structure was determined. Study 2 determined whether the original structure was maintained in the adapted 
version, and the levels of validity and reliability of the Turkish REMO was examined. In Study 3, measurement 
invariance across sex was tested, and the differences between the scores of the two groups were analyzed. 

According to the results of Study 1, the linguistic equivalence of the scale was achieved. However, several items 
needed to be revised. Study 2 showed that the structure of the original REMO (P-REMO with three sub-factors 
and T-REMO with two sub-factors) was preserved in the adapted version. In addition, evidence was provided for 
the validity, reliability of the Turkish version of the scale. In Study 3, configural invariance across sex was 
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maintained in all subscales; however, metric invariance across sex models was not achieved in any of the 
subscales. Additionally, the roles of teachers and peers as motivators were different for girls and boys whereas 
the role of individual learning did not show any difference between the two groups. 

This study suggests that the factor structure of the Turkish REMO is similar to the original scale despite the 
cultural differences between the Turkish and German students. Turkish students come from a collectivistic 
culture (Kagitcibasi, 1996) while German students from an individualistic culture (Trumbull & Rothstein-Fisch, 
2011) with different characteristics. In the near future, this study can be extended to explore potential differences 
between German and Turkish adolescents in their socio-motivational relations with their peers and teachers, 
which would allow comparing the cultural differences between the two countries. 

When the findings obtained from Studies 1 and 2 are evaluated, the psychometric properties of the Turkish 
REMO indicate that it is a valid and reliable scale for measuring the relationships of students with their peers and 
teachers as motivators. Additionally, the total explained variance and reliability coefficients of T-REMO were 
found to be higher than those of P-REMO although the number of items included in the former was less 
compared to the latter. One of the possible explanations for this result may be that students consider their 
relationships with their teachers as more important than peer relationships as suggested by Trumbull and 
Rothstein-Fisch (2011). Moreover, several modification indices related to the factor structure of the Turkish 
REMO did not show a good fit of the model. The lower values of modification indices compared to the original 
REMO may be attributed to the variations in the measured structure according to different cultures. During the 
adaptation process, some problematic words or phrases were encountered and they were revised. Furthermore, 
due to the potential differences between different cultures regarding motivational dependency on teachers and 
peers (e.g., Chiu & Chow, 2010; Flesse, 2004), it may be difficult to establish a model with the same factor 
structure and loadings for Turkish students as members of a collectivistic culture and for German students as 
members of an individualistic culture. 

In Study 3, based on the results of measurement invariance for the adapted P-REMO, the constructs were found 
to be somewhat different for boys and girls. The results regarding metric invariance revealed that several items 
(i.e., item 6 “My friends and I motivate each other to make an effort at school”, item 12 “When my friends find 
school boring, I also tend to find school tiresome”, and item 26 “I will study harder for an exam when my friends 
tell me that they are also working hard”) were found to have higher factor loadings on their corresponding 
factors for the group of girls. These items were better indicators of peers influence on the motivation of girls. 
These findings are supported by the study of Goodenow and Grady (1993), who indicated that girls are more 
susceptible to peer influence. Considering the characteristics of their friendship, girls are more likely to establish 
close and dependent relationships with their peers (Flenrich, Blatt, Kuperminc, Zohar, & Leadbeater, 2001). 
Therefore, in order not to be alone, they tend to care more about what their friends think. This may also result 
from the culture of obedience in Turkey (Goka, 2006). Goka explains that in this culture, especially the level of 
girls’ autonomy is lower than that of boys. In educational settings, this may cause girls to be more dependent in 
their relations with peers and teachers. Flowever, in the presents study, girls and boys did not differ in individual 
learning behavior. This may be related to the social culture in Turkey. Specifically, in the collectivist countries 
such as Turkey, a high value is given to the interdependency of its members (Kagitcibasi, 1996). In the 
educational context, students from collectivistic cultures exhibit more socio-motivational dependence (Chiu & 
Chow, 2010). On the other hand, in the individualistic countries such as Germany, socio-motivational 
dependence is not a dominant factor for students. Rather, these students are seen as independent and 
self-contained individuals (Flesse, 2004). 

Multi-group invariance testing across sex revealed that the factor structure of the adapted T-REMO was a 
satisfactory representation of teachers’ role as a motivator for both boys and girls. That is, configural invariance 
was obtained across both gender groups. On the other hand, the results of metric invariance indicated that the 
factor loadings of the T-REMO items showed inconsistency across sex. That is, the contribution of the items to 
determining the role of teachers as motivators differed for boys and girls. Therefore, when the factor loadings of 
the items were examined, it was concluded that item 4 (i.e., “when a teacher likes me, I make more effort in the 
subject”) had a higher factor loading on its corresponding factor for the group of girls. The findings of the study 
are consistent with earlier research on adolescent perceptions of caring teachers (Sullivan, Ricco, & Reynolds, 
2008). The authors revealed that the girls were more likely to receive care from their teacher, which in turn 
positively affected their academic motivation. That is, girls’ perception of their closeness determines the level of 
their motivation. On the other hand, boys tended to have conflictual relations with their teachers and they are 
also emotionally less attached to their teachers. This situation causes boys to have a low level of motivation and 
attendance to school (Fluan, Quek, Yeo, Ang, & Chong, 2012). The results of the t-test analysis also supported 
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these findings. More precisely, girls had statistically significantly higher mean scores for this subscale. Similar to 
the previous results on T-REMO, these results also show that girls are more likely to be influenced by their 
teachers. 

As a result, the adapted scale provided information about the relations of students with their peers and teachers, 
and how these relations motivate them. Therefore, it is considered to be relevant for education stakeholders. 
School psychologists can utilize this scale to gain insight into the roles of peers and teachers in the motivational 
process of students. This way, they can detect motivational problems in school, which will help improve the 
characteristics of the class environment and academic achievement. 

This study has certain limitations. Firstly, the participants were selected only from three provinces, which may 
affect the generalizability of the findings. Moreover, in this study, criterion validity could not be performed with 
other measurement tools. Therefore, there is a need for further studies, in which other assessment instruments 
available in the literature will be used to assess students’ motivation. In this study, P-REMO and T-REMO scores 
differed between boys and girls. In this regard, studies focusing on differential item functioning should be carried 
out with the data gathered from the adapted REMO in terms of different variables (e.g., sex and class). 

In this study, multi-level model analyses could not be performed since the research was not based on a design 
with a multi-level basis; thus, some of the assumptions of the model were not met. Future studies can be 
conducted using multi-level models. Moreover, it is recommended that studies focusing on differences sex and 
utilizing the Turkish REMO should establish measurement invariance in order to make valid inferences. 
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